Image display device and image display system

ABSTRACT

There is provided an image display device including a display control unit having a display combining unit that displays one or a plurality of pathological index cursors based on information relating to a pathological slide image.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is a continuation application of U.S. patentapplication Ser. No. 15/967,783, filed on May 1, 2018, which is acontinuation application of U.S. patent application Ser. No. 14/665,703,filed on Mar. 23, 2015, now issued as U.S. Pat. No. 9,966,045, which isa continuation application of U.S. patent application Ser. No.13/973,339, filed on Aug. 22, 2013, now issued as U.S. Pat. No.9,620,089, which claims priority from prior Japanese Priority PatentApplication JP 2012-210577 filed in the Japan Patent Office on Sep. 25,2012, the entire content of which is hereby incorporated by reference.

BACKGROUND

The present disclosure relates to an image display device, an imagedisplay system, an image processing method, and a program that displayan image captured by a microscope, and a microscope system capable ofimproving efficiency in case diagnosis. More particularly, the presentdisclosure relates to technology for improving efficiency in thediagnosis of a case employing a digital microscope.

In the fields of medicine, pathology, biology, materials, and the like,a technique of divisionally capturing an observation target area using adigital microscope and joining a plurality of obtained partial imagestogether to obtain a wide view and high power microscopic observationimage is in use. In a virtual microscope system using this technique, auser can cause an obtained microscopic observation image to be displayedat a random position and a random magnification, and can also cause theobtained microscopic observation image to be displayed at a remote placevia a network. For such a reason, the technique is attracting attentionparticularly in the uses of biopsy and cell inspection in pathologicaldiagnoses.

In the related art, a technique of displaying various kinds ofinformation on a display unit together with a microscopic observationimage (see Japanese Unexamined Patent Application Publication No.2011-181015) has been proposed to improve convenience of a user, forexample, in a medical institution.

In a pathological diagnosis system disclosed in Japanese UnexaminedPatent Application Publication No. 2011-181015, a diagnosis-demandingarea and the like is displayed in addition to a dyed sample image(microscopic observation image), and a user makes a pathologicaldiagnosis while appropriately modifying the microscopic observationimage and the image diagnosis-demanding area displayed on a displayunit.

SUMMARY

However, in the existing virtual microscope system described above, auser himself or herself makes a final determination to appropriatelymodify an image diagnosis area displayed on a display unit, and makes apathological diagnosis. In such a situation, there is insufficientinformation for the user to make most important case determinations, anda complicated separate manipulation on a screen is necessary to acquireor manipulate the information for making a case determination. In otherwords, it is difficult to say that efficiency in a diagnosis operationemploying a digital microscope is improving.

It is desirable to provide an image display device, an image displaysystem, a microscope system, an image processing method, and a programthat is capable of improving a diagnosis operation employing a digitalmicroscope and display an image captured by the microscope.

According to an embodiment of the present disclosure, there is providedan image display device including a display control unit having adisplay combining unit that displays one or a plurality of pathologicalindex cursors based on information relating to a pathological slideimage.

The display combining unit may change a size of a pathological indexcursor according to a magnification of the pathological slide image.

The display combining unit may cause a pathological index cursor toblink and/or vary in color according to classification of cancer stages.

The display combining unit may display a rotatable and/or movablepathological index cursor.

The display combining unit may display a pathological slide image and acancer index list for selecting the pathological index cursors.

The cancer index list may be one or two or more types of data selectedfrom cancer invasion distance data, cancer invasion area data, cancerinvasion depth data, cancer staining data, nucleo-cytoplasmic ratiodata, etiological microbe number data, and cancer stage classificationdata.

The display control unit may further process data relating to apathological slide image, cancer case data, and cancer index list datatransmitted from an information provision device including a dataresponse unit that acquires cancer index list data based on theinformation relating to the pathological slide image, and the imagedisplay device display the pathological slide image and the cancer indexlist.

The information provision device may further include an informationholding unit that holds data relating to a pathological slide image,cancer case data, and cancer index list data corresponding to thepathological slide image data, and the data response unit may acquirethe data relating to the pathological slide image, the cancer case data,and the cancer index list data corresponding to the pathological slideimage from information holding unit based on the information relating tothe pathological slide image, and transmit the acquired data to thedisplay control unit.

According to an embodiment of the present disclosure, there is providedan image display system including an image display control unit having adisplay combining unit that displays one or a plurality of pathologicalindex cursors based on information relating to a pathological slideimage.

The image display system may further include an information provisiondevice having a data response unit that acquires cancer case data andcancer index list data corresponding to the cancer case data based onthe information relating to the pathological slide image.

According to an embodiment of the present disclosure, there is provideda microscope system including an image display system including an imagedisplay device having a display combining unit that displays one or aplurality of pathological index cursors based on information relating toa pathological slide image.

The image display system may further include an information provisiondevice having a data response unit that acquires cancer case data andcancer index list data corresponding to the cancer case data based onthe information relating to the pathological slide image, and transmitsthe acquired data to the image display device.

According to an embodiment of the present disclosure, there is providedan image processing method including displaying one or a plurality ofpathological index cursors based on information relating to apathological slide image.

The image processing method may further include acquiring cancer casedata and cancer index list data corresponding to the cancer case databased on the information relating to the pathological slide image, anddisplaying the pathological slide image and a cancer index list forselecting the pathological index cursors based on the cancer case dataand the cancer index list data corresponding to the cancer case data.

One or a plurality of pathological index cursors selected from thecancer index list may be displayed.

Cancer case data corresponding to the data relating to the pathologicalslide image and cancer index list data corresponding to the cancer casedata may be acquired based on the information relating to thepathological slide image.

According to an embodiment of the present disclosure, there is provideda program causing an image display device to perform an informationprovision function of acquiring and transmitting cancer case datacorresponding to information relating to a pathological slide image andcancer index list data corresponding to the cancer case data based onthe information, and an image display function of displaying a cancerindex list for selecting a pathological index cursor based on the cancerindex list data.

According to an embodiment of the present disclosure, there is provideda program causing an image display device to perform an informationprovision function of holding data relating to a pathological slideimage, cancer case data corresponding to the data relating to thepathological slide image and cancer index list data corresponding to thecancer case data, and acquiring and transmitting cancer case datacorresponding to information relating to the pathological slide imageand cancer index list data corresponding to the cancer case data basedon the information, and an image display function of displaying a cancerindex list for selecting a pathological index cursor based on the cancerindex list data, and also displaying one or a plurality of pathologicalindex cursors selected from the cancer index list.

According to the present disclosure described above, it is possible toimprove efficiency in a diagnosis operation employing a digitalmicroscope.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram showing an outline of a microscope system accordingto a first embodiment of the present disclosure;

FIG. 2 is a block diagram showing a configuration example of a digitalmicroscope 1 shown in FIG. 1;

FIG. 3 is a block diagram showing a configuration example of aninformation processing device 2 shown in FIG. 1;

FIG. 4 is a block diagram showing a configuration example of aninformation provision device (server) 3 shown in FIG. 1;

FIG. 5 is a block diagram showing a configuration example of an imagedisplay device 4 shown in FIG. 1;

FIG. 6 is a flowchart illustrating transmission of various kinds of dataof a cancer case list to the image display device 4 by a slide ID/casedata holding unit 332;

FIG. 7 is a diagram showing a state in which an example of “slideID—cancer case list” is shown on a display unit 41;

FIG. 8 is a diagram showing a state in which an example of “cancercase—cancer index list” is shown on the display unit 41;

FIGS. 9A and 9B are diagrams showing a state in which “pathologicalslide image a,” “cancer index list b,” and “pathological index cursor c”are displayed on the display unit 41 in the form of a cursor;

FIGS. 10A, 10B, and 10C are diagrams showing a state in which“pathological slide image a,” “cancer index list b,” and “pathologicalindex cursor c” are displayed on the display unit 41 in the form of anarrow;

FIG. 11 is a flowchart illustrating acquisition of various types of datarelating to a pathological slide image (combined image) by a dataselection/cancer index list data acquisition unit;

FIG. 12 is a flowchart illustrating acquisition and decoding of varioustypes of data relating to a pathological slide image (combined image) bya data selection/cancer index list data acquisition unit;

FIG. 13 is a flowchart illustrating acquisition of data relating to acombined image and decoding of the combined image by a slide image dataselection/decoding unit; and

FIG. 14 is a flowchart for displaying a pathological index cursor.

DETAILED DESCRIPTION OF THE EMBODIMENT(S)

Hereinafter, preferred embodiments of the present disclosure will bedescribed in detail with reference to the appended drawings. Note that,in this specification and the appended drawings, structural elementsthat have substantially the same function and structure are denoted withthe same reference numerals, and repeated explanation of thesestructural elements is omitted. Description will be made in thefollowing order.

1. First Embodiment of Present Disclosure 1. First Embodiment

[Configuration of Microscope System]

First, a virtual microscope system according to a first embodiment ofthe present disclosure will be described.

FIG. 1 is a diagram showing an outline of a microscope system of thisembodiment. The microscope system of this embodiment is intended tocapture and observe various prepared samples at a high magnification.The corresponding microscope system includes, for example, as shown inFIG. 1, a digital microscope 1, an information processing device 2, aninformation provision device (server) 3, an image display device 4, andthe like.

In the microscope system of this embodiment, the information processingdevice 2 and the image display device 4 may be connected directly or viaa network 5. Also, the information processing device 2 and the imagedisplay device 4 may be connected with the information provision device3 via the network 5 to be able to communicate with the informationprovision device 3.

The information provision device 3 may double as the informationprocessing device 2, or the information processing device 2 may doubleas the information provision device 3.

The image display device 4 may include the information processing device2 and/or the information provision device 3. Since it is preferable tostore various kinds of data in the information provision device 3, it isappropriate for the information display device 4 and the informationprovision device 3 to be separately configured in this embodiment.

Although only one of each device is shown in FIG. 1 for convenience tosimplify the description, each device may be singular or plural innumber, and the plurality of devices may be organically connected witheach other. For example, when there are a plurality of image displaydevices, it is possible to share an image or information displayed on ascreen among users in a medical institution or between a user and apatient.

The virtual microscope system of this embodiment can be applied invarious fields such as medicine, pathology, biology, materials, and thelike. For example, when the virtual microscope system of this embodimentis used for a pathological diagnosis, an observation object is an organof a living body, tissue, cells, and the like, pieces of which areenclosed in prepared samples. For example, when the prepared sample is apathological sample, a user of the image display device 4 (viewer of animage) is a doctor and the like, who makes a pathological diagnosisbased on a displayed image.

Although, in the virtual microscope system of this embodiment, a user orthe like makes a diagnosis of a case, status, and the like of cancer, itis important for this embodiment to have at least the image displaydevice 4 according to an embodiment of the present disclosure, andfurther, it is appropriate to cooperate with the information provisiondevice 3.

[Digital Microscope 1]

A digital microscope 1 includes a light source, an objective lens, animage sensor, a stage, and the like, and radiates predeterminedillumination light to a prepared sample placed on the stage to capturelight transmitted through the observation object, light emitted from theobservation object, or the like. FIG. 2 is a block diagram showing aconfiguration example of the digital microscope 1. As shown in FIG. 2, awhole image capturing unit 11 and a partial image capturing unit 12 areinstalled in the digital microscope 1 included in the microscope systemof this embodiment.

The whole image capturing unit 11 includes a light source, a low powerobjective lens, a low resolution image sensor, and the like, andperforms imaging of an entire observation target area of the preparedsample placed on the stage at a low magnification and a low resolution.On the other hand, the partial image capturing unit 12 includes a lightsource, a high power objective lens, a high resolution image sensor, andthe like, and performs imaging of a part of the observation target areaof the prepared sample placed on the stage at a high magnification and ahigh resolution. In other words, by the digital microscope 1, a lowresolution whole image (thumbnail image) and a partial image (slideimage) of a higher resolution than the whole image are captured.

In addition, an imaging device controller 13 that controls processing ofimaging by the whole image capturing unit 11 and the partial imagecapturing unit 12, an input and output interface unit 14 for connectingto the information processing device 2, or the like may be installed inthe digital microscope 1. By installing the input and output interfaceunit 14, it becomes possible to input a control command from theinformation processing device 2 or output respective pieces of data ofimages captured by the whole image capturing unit 11 and the partialimage capturing unit 12 to the information processing device 2.

[Information Processing Device 2]

FIG. 3 is a block diagram showing a configuration of the informationprocessing device 2. As shown in FIG. 3, an image generation unit 22that joins partial images (slide images) captured by the digitalmicroscope 1 together is installed in the information processing device2. In addition, an imagingcontrol unit 21, an image processing unit 23,a central processing unit (CPU) 24, a memory 25, a hard disk 26, inputand output interface units 27 and 28, and the like may be installed inthe information processing device 2.

(Image Generation Unit 22)

FIG. 4 is a block diagram showing a configuration of the imagegeneration unit 22. As shown in FIG. 4, the image generation unit 22includes an image combining unit 221 that joins a plurality of partialimages (slide images) in which parts of an observation target area aretaken together, and a junction information generation unit 222 thatgenerates junction information on a combined image combined by the imagecombining unit 221.

The image combining unit 221 joins the plurality of partial images(slide images) captured by the digital microscope 1 together to generatea high power, high resolution and wide view microscopic observationimage (combined image). Specifically, a matching process is performed onthe partial images to be joined (slide images), and the partial images(slide images) are joined together (stitched) based on a result of thematching process.

Also, the image combining unit 221 is capable of attaching identifiersto various kinds of slide image data such as a combined image(microscopic observation image) and the like to use the identifiers asinformation on pathological slide images.

Meanwhile, as the junction information on the combined image combined bythe image combining unit 221, the junction information generation unit222 generates, for example, information on junction positions of therespective partial images (slide images) and information on reliabilityof junction at the respective junction positions. In the junctioninformation, information about presence or absence of a foreignsubstance or a position of a foreign substance may be included.

For example, as the junction reliability information, the relativeamount of difference between adjacent partial images (slide images)caused by the stitching process may be acquired.

The combined image combined by the image combining unit 221 (wide viewmicroscopic observation image) and the various kinds of junctioninformation generated by the junction information generation unit 222are output to the server 3 or the image display device 4 via the inputand output interface unit 28 and the network 5.

(Imaging Control Unit 21)

The imaging control unit 21 can control driving of the digitalmicroscope 1 upon capturing of a partial image (slide image), the wholeimage (thumbnail image), and the like, operation of the image generationunit 22 and the image processing unit 23, or the like.

(Image Processing Unit 23)

The image processing unit 23 performs an analysis of the whole image(thumbnail image) in which the entire observation target area iscaptured, construction of a sequence in which the digital microscope 1captures partial images (imaging sequence), and the like. The imagingsequence constructed here is output to the imaging control unit 21.

(CPU 24)

The CPU 24 controls the respective units installed in the informationprocessing device 2 overall, and executes a program that controls, forexample, the image processing unit 23, the imaging control unit 21, andthe like described above overall. Also, the CPU 24 can carry outcalculation processes performed in the respective units of theinformation processing device 2, or carry out encoding of an image, apattern matching process of partial images performed in the imagecombining unit 221, and the like.

(Memory 25)

The memory 25 is used as a work area of the CPU 24, and temporarilystores the partial images (slide images), the whole image (thumbnailimage), and the like that are captured by the digital microscope 1 andinput from the input and output interface unit 27.

(Hard Disk 26)

In the hard disk 26, for example, processing results (imaging sequenceand the like) of the image processing unit 23 and the like, the combinedimage combined by the image combining unit 221 (wide view microscopicobservation image), the junction information generated by the junctioninformation generation unit 222, and the like are stored.

In addition, a computer program for implementing the respectivefunctions of the information processing device 2 described above can becreated and installed in a personal computer and the like. Such acomputer program may be stored in storage media, for example, a magneticdisk, an optical disc, a magneto-optical disc, a flash memory, and thelike, and can also be delivered via a network.

[Information Provision Device (Server) 3]

The information provision device 3 manages various kinds of datauploaded from the information processing device 2, and outputs thevarious kinds of data to the image display device 4 or the informationprocessing device 2 in response to a request.

FIG. 4 is a block diagram showing a configuration example of theinformation provision device 3. As shown in FIG. 4, the informationprovision device (server) 3 is connected with the information processingdevice 2 and the image display device 4 via the network 5. Theinformation provision device (server) 3 includes a hard disk 31, a dataresponse unit 32, an information holding unit 33, a CPU 34, a memory 35,input and output interface units 36 and 37, and the like.

(Data Response Unit 32)

The data response unit 32 can request the information processing device2 to transmit various kinds of data, such as data relating to thecombined image and the like, and causes the information holding unit 33to store the various kinds of data received from the informationprocessing device 2.

As the data relating to the combined image, there are various kinds ofdata, for example, combined image (wide view microscopic observationimage) and junction information, a low resolution whole image (thumbnailimage), partial images to be joined (slide images), imaging sequenceinformation, and the like.

Hereinafter, “combined image (wide view microscopic observation image)”is also referred to as “pathological slide image,” “combined image,” or“combined image (observation image).”

In addition, “low resolution whole image (thumbnail image)” is alsoreferred to as “whole image (thumbnail image).”

Furthermore, “partial images to be joined (slide images)” are alsoreferred to as “partial images” or “partial images (slide images).”

For example, the data response unit 32 may cause the informationprocessing device 2 to transmit a pathological slide image through datasegmentation such as packet transmission or the like, receive the data,and then recover the pathological slide image from the data. Also, thedata response unit 32 may cause the information processing device 2 totransmit partial images and imaging sequence information, receive thepartial images and the imaging sequence information, and then recover apathological slide image from the partial images based on an imagingsequence of the imaging sequence information.

In addition, a user or the like selects a slide ID, such that the dataresponse unit 32 can request the information holding unit 33 storingvarious kinds of data to transmit various kinds of data corresponding tothe slide ID to the information processing device 2, the image displaydevice 4, and the like.

For example, as shown in FIG. 6, a user or the like selects a slide IDwhen making a diagnosis, such that the data response unit 32 requests “acancer case” corresponding to the slide ID from the information holdingunit 33 and specifies “a cancer case.” Also, the data response unit 32transmits data of “the slide ID and the cancer case” to the imagedisplay device 4. Since the corresponding various kinds of data aredisplayed as a combined image (for example, see FIG. 7), it becomes easyfor the user to check the slide ID and the medical case, and mistakessuch as misunderstanding of a sample in use and the like can be reduced.

Furthermore, by deciding “a cancer case,” the data response unit 32searches for and specifies one or a plurality of “cancer index lists”that have been stored in the information holding unit 33 in advance andcorrespond to the cancer case. Also, the data response unit 32 transmitsdata of the one or plurality of “cancer index lists” to the imagedisplay device 4. The “cancer index lists” are displayed (for example,see FIG. 8), and thus it is possible to display an index used in one ora plurality of diagnoses of cancer, such that efficiency in a cancerdiagnosis operation of the user is improved.

(Information Holding Unit 33)

The information holding unit 33 can store various kinds of data such asdata relating to the above-described combined image transmitted from theinformation processing device 2, data processed by the image displaydevice 4, and the like.

The information holding unit 33 includes a slide image data holding unit331, a slide ID/case data holding unit 332, and a cancer index listholding unit 333, and stores and holds various kinds of data in therespective units. Also, the information holding unit 33 is controlled bythe data response unit 32, such that the corresponding data responseunit 32 can have control over a process of reading and writing variouskinds of data held in the information holding unit 33, an imagecombining process, and the like.

(Slide Image Data Holding Unit 331)

In the slide image data holding unit 331, the above-described datarelating to the pathological slide image and an identifier attached tothe data are stored. Also, the slide image data holding unit 331 canlink an identifier to data relating to a stored pathological slideimage. The linking makes it possible to obtain information relating tothe pathological slide image.

(Slide ID/Case Data Holding Unit 332)

In the slide ID/case data holding unit 332, a slide ID of data relatingto one pathological slide image and data of one cancer casecorresponding to the data relating to the pathological slide image arestored in connection with each other (for example, see FIG. 6). Byselection of a user or the like, data of a plurality of cancer casescorresponding to data relating to one pathological slide image may bestored in connection with the data relating to the pathological slideimage.

A “slide ID” may be a random number input by a user or the like, or theslide ID/case data holding unit 322 or the data response unit 32 mayselect and combine the “slide ID” from among a patient number, acheck-up date, a check-up number, a check-up item, a sample number, abranch number of the sample number, a random number of the user, and thelike. Preferably, the patient number and the like are stored in theinformation provision device 3.

Although this will be described later, a “cancer case” refers to a caseof cancer such as stomach cancer, lung cancer, colon cancer, and thelike.

Data of a “slide ID” and/or “cancer case” can be linked to combinedimage data as an “identifier” by the slide ID/case data holding unit 322or the data response unit 32. In this linked state, the data of a “slideID” and/or “cancer case” and the combined image data may be stored inthe slide ID/case data holding unit 332.

“Linking” of an identifier of a slide ID or the like may be performed byan input of a user or the like when a clinical material is observedthrough a microscope, when combined image data is processed, etc. Also,linking of an “identifier” to a check-up item, a patient number, acheck-up date, and one or two or more selected from among a check-upnumber, a sample number, and a branch number of the sample number may beperformed by the data response unit 32. The linking makes it possible toobtain information relating to the pathological slide image.

As an example, the data response unit 32 requests the data relating tothe combined image and the like from the information processing device 2that stores the data of the combined image and the like, and requests acheck-up item, a check-up number, and the like corresponding to therequested data from the information holding unit 33. Also, the dataresponse unit 32 combines an identifier with pathological slide imagedata—“slide 01—stomach cancer” and the like such that the identifier isattached to the pathological slide image data. For this reason, it ispossible to obtain information relating to the pathological slide image.The data (information) is held in the information holding unit 33.

When pathological slide image data is not held in the informationprovision device 3, the data response unit 32 can request pathologicalslide image data from one device (for example, the informationprocessing device 2) by selecting an identifier such as “slide01—stomach cancer” or the like. Also, the data response unit 32 cantransmit the pathological slide image data to the image display device 4and display the pathological slide image data on a display unit 41.

(Cancer Index List Holding Unit 333)

In the cancer index list holding unit 333, cancer index lists that arevarious lists used as indices to diagnose cancer are stored.

Cancers diagnosed by the present disclosure are not particularlylimited. For example, the cancers diagnosed by the present disclosureinclude brain tumors, breast cancer, cervical cancer, ovarian cancer,esophageal cancer, stomach cancer, colon cancer, anal cancer, livercancer, pancreatic cancer, laryngeal cancer, oral cancer, tongue cancer,thyroid cancer, kidney cancer, lung cancer, osteosarcomas, prostatecancer, testicular tumors, renal cell carcinomas, bladder cancer,rhabdomyosarcomas, skin cancer, leukemia, and the like.

Since it is known that viral or bacterial infections are involved inthese cancers, examination of etiological microbes is also important indiagnosis (examination) of cancer. For example, human papilloma virusestype 16 and type 18 are implicated in cervical squamous cell cancer;human T-cell lymphotropic virus is implicated in adult T-cell leukemia;hepatitis B virus (HBV) is implicated in hepatocellular carcinomas;hepatitis C virus (HCV); Helicobacter pylori is implicated in stomachcancer; and the like.

As an index generally used in diagnosis of cancer, TNM classification ofthe Union for International Cancer Control (UICC) is internationallyused. In Japan, classification of disease stages based on“Classification of disease stages according to stomach cancer handlingagreement,” “Colon cancer handling agreement,” and the like arranged byacademic associations, the Ministry of Health, Labour and Welfare, andthe like is widely used.

When a cancer diagnosis is made, a region, a size of a clinicalmaterial, naked eye classification, a size of a lesion, a histologicaltype, an invasion depth, lymphatic vessel invasion, vein invasion, ahorizontal margin (distance), a vertical margin (distance), and the likeare checked.

A “cancer index list” according to an embodiment of the presentdisclosure is obtained by listing classified disease stages generallyused in diagnosis of cancer as described above according to each cancercase.

In a cancer index list according to an embodiment of the presentdisclosure, invasion distance of cancer, invasion depth of cancer,cancer staining, a nucleo-cytoplasmic ratio, etiological microbes,classification of cancer stages, and the like are written regarding eachcancer case. Using the cancer index list according to an embodiment ofthe present disclosure as a reference, a user (doctor or the like) orthe like can diagnose the status of cancer.

“Cancer staining” indicates staining of cancer tissue, and includesimmunohistochemical staining, staining with a dye such as Lugol dye, andthe like.

Data of one or a plurality of classified disease stages of each cancercase is stored and held in the cancer index list holding unit 333 as the“cancer index list” according to an embodiment of the presentdisclosure. The “cancer index list” can be input in advance and held.When the “cancer index list” is selected, data relating to the “cancerindex list” can be acquired based on a “case of cancer” and the “cancerindex list” from a homepage of an academic association and the like viaa network.

A detailed “cancer index list” includes, for example, data of cancerinvasion distance, data of cancer invasion area, data of cancer invasiondepth, cancer staining data, nucleo-cytoplasmic ratio data,cancer-causing microbe number data, cancer stage classification data,and the like. One or two or more selected from among these pieces ofdata may be used. These are mainly used to diagnose cancer based onlength and/or color.

One or a plurality of “cancer index lists” are attached to each case ofcancer. For example, referring to FIG. 8, a cancer invasion distancelist of “5 mm, 10 mm, and 15 mm” that is one cancer index list isdisplayed in “stomach cancer” that is one case of cancer.

For this reason, by selecting a “slide ID” or a “case of cancer”attached to combined image data as an identifier, one or a plurality ofcancer index lists corresponding to the case of cancer are displayed onthe display unit 41.

When two or more index lists correspond to one case of cancer, asequence of displayed index lists can be set in advance by a user or thelike. Also, the sequence of displayed index lists may be set such thatcancer index lists corresponding to a check-up item are displayed bypriority.

For example, when cancer cell staining is a check-up item, cancerstaining data is automatically moved upward in a cancer index list.Also, when a check-up item is for seeing cancer invasion, data of cancerinvasion distance, data of cancer invasion area, and data of cancerinvasion depth are automatically moved upward.

When a check-up item is for observing etiological microbes,cancer-causing microbe number data is moved upward. Also, when acheck-up item is for observing cancer cells with a microscope,nucleo-cytoplasmic ratio data obtained by dividing the volume of thenucleus of a cell by the volume of the cytoplasm is automatically movedupward.

In addition, since cancer stages are generally classified as diagnosisresults, cancer stage classification data may be shown upward, orprepared as a symbol that can be easily selected by a user.

(CPU 34)

The CPU 34 controls the respective units installed in the informationprovision device 3 overall, and thus executes a program that controlsthe data response unit 32, the information holding unit 33, and the likedescribed above overall. Also, the CPU 34 can carry out calculationprocesses performed in the respective units of the information provisiondevice 3, or carry out encoding of an image, a pattern matching processof partial images performed in an image combining unit, and the like.

(Memory 35)

The memory 35 is used as a work area of the CPU 34, and temporarilystores the partial images (slide images), the whole image (thumbnailimage), a slide ID, a case of cancer, a cancer index list, and the likethat are transmitted from the outside and input through the input andoutput interface units 36 and 37.

(Hard Disk 31)

In the hard disk 31, for example, processing results of the dataresponse unit 32 and the like are stored.

In addition, a computer program for implementing the respectivefunctions of the information provision device 3 described above can becreated and executed in a personal computer and the like. Such acomputer program may be stored in storage media, for example, a magneticdisk, an optical disc, a magneto-optical disc, a flash memory, and thelike, and can also be delivered via a network.

Here, the information provision device 3 described above can be includedin the image display device 4 as an information provision unit.

[Image Display Device 4]

FIG. 5 is a block diagram showing a configuration example of the imagedisplay device 4. As shown in FIG. 5, the image display device 4 isconnected with the information processing device 2 and/or theinformation provision device (server) 3 via a network. The image displaydevice 4 includes the display unit 41, a display control unit 42, a CPU43, a memory 44, a hard disk 45, an input and output interface unit 46,and the like.

Using an input device (not shown) such as a keyboard, a pointing device(mouse, trackball, touchpad, and the like), and the like, it is possibleto input information (text and the like) to the image display device 4or perform point and click. When the display unit 41 is in the form of atouch panel, it is possible to make an input or perform point and clickon a screen.

(Display Unit 41)

The display unit 41 displays information for performing a diagnosisoperation employing a digital microscope, and enables the correspondinginformation to be read. Displayed information includes, for example, aclinical material image such as a combined image, a slide ID, a cancerindex list, a pathological index cursor, and the like. As displayinformation, a pathological slide image (clinical material image), aslide ID, and a cancer index list may be appropriately displayed incombination, and the display information may be, for example, a list of“slide ID—cancer cases,” a list of “cancer case—cancer index lists,” andthe like.

For example, when a cancer diagnosis operation is performed, apathological slide image, cancer index lists for selecting theaforementioned cursor, and the like are displayed in the display unit 41as shown in FIGS. 9A, 9B, 10A, 10B and 10C. By selecting one cancerindex list for selecting the aforementioned cursor, a mouse pointer isturned into a pathological index cursor (for example, in the form of aruler, a seal, or the like) and displayed. In the case of a ruler form,the length, size, direction and the like of the ruler may be changedaccording to the selected cancer index list. Also, in the case of a sealform, a seal can blink, vary in color, and function as a descriptionframe according to the selected cancer index list.

Also, by selecting one of the cancer index lists for selecting theaforementioned cursor, a new pathological index cursor may be displayedwith no change in the mouse pointer, and in this case, it is possible tohandle the cursor using a plurality of pointing devices or by touchmanipulation.

(Display Control Unit 42)

The display control unit 42 includes an information access processingunit 421 and a display combining unit 422, and controls these overall.

The information access processing unit 421 requests and acquires variouskinds of necessary data from the information provision device (server) 3having the data response unit 32 and the information holding unit 33based on information relating to pathological slide image data (anidentifier attached to the data relating to a pathological slide image).At this time, cancer case data, the cancer index list data, and the datarelating to a pathological slide image (combined image) requested by theinformation access processing unit 421 is transmitted from theinformation provision device 3.

The display combining unit 422 of the display control unit 42 processesvarious kinds of data such as the transmitted cancer case data, cancerindex list data, and the like, and displays a processed image(pathological slide image, cancer index list, pathological index cursor,and the like), text information, or the like in the display unit 41.

(Information Access Processing Unit 421)

The information access processing unit 421 requests the informationprovision device 3 to transmit various kinds of data such as the datarelating to the combined image, the cancer index list data, the slide IDdata, and the like to the image display device 4. The information accessprocessing unit 421 may hold the various kinds of acquired data in theHDD 45, the memory 44, or the like of the image display device 4 asnecessary. Also, the information access processing unit 421 may performprocessing such as decoding (recovery) of the various kinds of acquireddata.

In addition, the information access processing unit 421 may include acombined image-related data selection/cancer index list data acquisitionunit and a combined image-related data request/decoding unit (notshown). Preparation of these improves operational efficiency.

Hereinafter, the combined image-related data selection/cancer index listdata acquisition unit will be referred to as a “dataselection/acquisition unit,” and the combined image-related datarequest/decoding unit will be referred to as a “request/decoding unit.”

[Combined Image-Related Data Selection/Cancer Index List DataAcquisition Unit]

When a user or the like selects the data relating to the combined imagedisplayed in the display unit 41, the corresponding slide ID is decidedby the data selection/acquisition unit as shown in FIGS. 11 to 13. Thisdecision causes the information provision device 3 to search for acancer case based on information relating to a pathological slide image(an identifier such as a slide ID or the like). In addition, the dataselection/acquisition unit requests the information provision device 3to transmit a result of searching for one or plurality of cancer caselists corresponding to the information relating to the pathologicalslide image (an identifier of a cancer case or the like) based on theinformation. By the request of the data selection/acquisition unit, theimage display device 4 acquires slide ID data, cancer case data, anddata of the one or plurality of cancer case lists corresponding to thecancer case based on the information relating to the pathological slideimage (the identifier). Furthermore, the data selection/acquisition unitcan hold these acquired pieces of data in the HDD 45 or the like.

These acquired pieces of data are combined with necessary informationsuch as a list of “slide ID—cancer cases,” a list of “cancer case—cancerindex lists,” a “cancer index list,” and the like by the display controlunit 42. In this way, a combined image, text information or the like ofa “slide ID—cancer case list,” a “cancer case—cancer index list,” a“cancer index list,” and the like is displayed in the display unit 41.

When a user or the like does not select data relating to the combinedimage but selects an identifier (for example, a slide ID, a cancer case,or the like), the data selection/acquisition unit can request andacquire various kinds of data from the information provision device 3based on the identifier. These acquired pieces of data are combined withnecessary information such as the list of “slide ID—cancer cases,” thelist of “cancer case—cancer index lists,” the “cancer index list,” andthe like by the display control unit 42.

[Slide Image Data Request/Decoding Unit]

As shown in FIG. 12, a user or the like selects a whole image (thumbnailimage) displayed in the display unit 41. When the whole image (thumbnailimage) is selected, the corresponding slide ID is decided, and therequest/decoding unit transmits the slide ID to the informationprovision device 3, acquires various kinds of data such as data relatingto a necessary combined image and the like, and decodes (recovers) theacquired data as necessary. The request/decoding unit can acquirepathological slide image data from the information provision device 3,recover the pathological slide image data, and transmit the recoveredimage to the display combining unit 422 that will be described below.These pieces of data are combined with a pathological slide image(combined image) by the display combining unit 422.

In addition, the user or the like selects a slide ID from a list of“whole image (thumbnail image)—slide IDs” or a list of slide IDs. Inthis way, the request/decoding unit can acquire various kinds of datarelating to an image from the information provision device 3 and decodethe acquired data.

(Display Combining Unit 422)

Based on information relating to the pathological slide image such asthe slide ID selected by the user or the like, combined image data, orthe like, the display combining unit 422 requests and acquires variouskinds of necessary data from the information provision device 3. At thistime, various kinds of data in the information relating to thepathological slide image are combined with a cancer case list, thecombined image, a cancer index list, and the like by the informationaccess processing unit 421 and transmitted to the display combining unit422. Here, the slide ID, a cancer case, and the like may function as anidentifier attached to the pathological slide image data.

The display combining unit 422 displays a cancer index list forselecting a pathological slide image (combined image) and a pathologicalindex cursor in the display unit 41.

When one cancer index is selected from a cancer index list, the displaycombining unit 422 combines a pathological index cursor corresponding tothe cancer index list.

The display combining unit 422 can decide a size of a pathological indexcursor based on a size of the slide combined image or the whole imageacquired from the information provision device 3 or the like. Expansionand contraction of a pathological index cursor corresponding to theimage may be held in advance in a memory, a storage unit, or the like.

Specifically, when the user selects determination based on distance,area, and the like such as cancer invasion distance data, cancerinvasion area data, cancer invasion depth data and the like, apathological index cursor that is in the form of a ruler whereby adistance or an area can be calculated and corresponds to a size of thecombined image or the like is decided. The pathological index cursor inthe form of a ruler is combined in the display combining unit 422 anddisplayed in the display unit 41. Shapes of the pathological indexcursor in the form of a ruler are not particularly limited, and include,for example, a triangular shape, a quadrangular shape, a square shape,an oval shape, a circular shape, and the like. The pathological indexcursor in the form of a ruler with gradations is appropriate forimproving efficiency in a diagnosis operation.

When the user selects determination based on a value such as a number, aratio, and the like including cancer staining data, nucleo-cytoplasmicratio data, cancer-causing microbe number data, and the like, apathological index cursor in the form of a seal whose value can bedetermined and that corresponds to a size of the combined image or thelike is decided. The pathological index cursor in the form of a seal iscombined in the display combining unit 422 and displayed in the displayunit 41. Forms of the seal are not particularly limited. For example,the seal may blink and/or vary in color to facilitate determination ofthe value, or a total of numbers or the degree of a ratio may beattached around the seal. Also, the seal may be displayed as an arrowand/or a frame for displaying text information.

When a determination is made based on cancer stage classification data,a picture or a value for determining a stage may be displayed, or thedetermination can be derived from the aforementioned cancer invasiondistance data, cancer invasion area data, cancer invasion depth data,cancer staining data, nucleo-cytoplasmic ratio data, cancer-causingmicrobe number data, and the like.

In addition, when a cancer index serving as a pathological index cursorin the form of a ruler is selected from a cancer index list, andfurther, a disease stage is selected, the display combining unit 422decides a size of the pathological index cursor to correspond to thesize and combines the pathological index cursor with the combined image.

When a cancer index serving as a pathological index cursor in the formof a seal is selected from a cancer index list, the display combiningunit 422 decides a size of the pathological index cursor to correspondto a size of the combined image and combines the pathological indexcursor with the combined image.

When the user or the like changes a display magnification of thedisplayed combined image, the display combining unit 422 can change asize of a pathological index cursor according to the displaymagnification of the pathological slide image. In this way, it ispossible to improve a cancer diagnosis operation and also reducemisdiagnoses.

Also, the display combining unit 422 may set a pathological index cursorto be rotatable and/or movable and display the pathological index cursorin the display unit 41. In this way, it becomes possible toappropriately select a direction of an arrow according to a shape of acancer region to be examined, and efficiency in a diagnosis operationimproves.

Further, the display combining unit 422 can set a displayed pathologicalindex cursor to blink and/or vary in color according to a classifiedstage of cancer. In this way, for example, when a number or size becomesa predetermined value (threshold) or more, a pathological index cursorblinks or varies in color, such that it becomes easy to understand aclassified disease stage, and efficiency in a diagnosis operationimproves.

Next, an image processing method of performing a display using themicroscope system of this embodiment such that a cancer diagnosisoperation can be performed will be described. In particular, a basicoperation in an image display process by the image display device 4 willbe described.

[Operation 1]

When a user selects a slide ID of data relating to a combined image inthe image display device 4, the display control unit 42 acquires one ora plurality of cancer case lists based on information relating to apathological slide image (for example, a linked slide ID or the like).

When a user selects information relating to a pathological slide image(for example, a slide ID or the like) in the image display device 4, thedisplay control unit 42 acquires data relating to the pathological slideimage (combined image) based on information relating to thecorresponding pathological image (for example, the slide ID or thelike). At this time, data such as a size of a sample, a size of thecombined image, and the like is included.

The display control unit 42 controls the acquired and combinedpathological slide image (combined image) and one or a plurality of caselists to be displayed. When the user selects any one of classifieddisease stages of a case list, a pathological index cursor is combinedwith the combined image and displayed. At this time, a size of thepathological index cursor is decided in consideration of a size of asample and a size of the pathological slide image (combined image). Forexample, in the case of a pathological index cursor in the form of aruler, a length such as a currently selected cancer invasion distanceand the like is calculated in consideration of the size of the sampleand the size of the combined image, and the pathological index cursorwith the size of the cursor is combined with the combined image anddisplayed.

The display control unit 42 may automatically select any of classifieddisease stages of a case list or the lowest of the disease stages, and apathological index cursor corresponding to the selected disease stagemay be combined with the combined image and displayed.

In the case of diagnosing cancer invasion distance, as a selection of aclassified disease stage, any one of numbers displayed according todistance in a “cancer index list” of FIGS. 9A and 9B are selected.

Since a pathological index cursor according to an embodiment of thepresent disclosure enables the user or the like to make a move,rotation, and the like of the displayed pathological index cursor (see apathological index cursor of FIGS. 9A and 9B), it is possible to easilyperform a cancer diagnosis operation.

Also, a pathological index cursor can be provided at a plurality ofpositions, and the user can use each pathological index cursor byselecting the pathological index cursor through appropriate clicking orthe like upon use of the pathological index cursor.

Further, the user or the like can select the whole image (thumbnailimage) displayed in the display unit 41 and perform a cancer diagnosisoperation in the flow as described above using an identifier attached tothe selected whole image.

In an existing system, a user refers to a laboratory information system(LIS) and the like for a sample number shown in an image display device.The user checks what a case of a combined image is based on informationof the LIS. Also, the user checks transitional tissue andnon-transitional tissue in the combined image. By manipulating a cursor,the user designates two points of transitional tissue, and measures thedistance. Based on the value measured by the user, the user searches fordiagnostic criterion data and the like and determines which stage ofcancer is appropriate, ultimately making a cancer diagnosis. Designationof two points is cumbersome for a user, and also, a large amount of dataof a combined image places a load on the processing capability of thedevice, which poses a risk of lowering the processing speed. In such asituation, efficiency in a cancer diagnosis operation of a userdeteriorates.

In addition, when there are a plurality of check-up items, it isnecessary to make a diagnosis while checking respective criteria, andthe diagnosis is made according to the check-up items one at a time,such that efficiency in the diagnosis operation is not good.

However, using an identifier according to the present disclosure, aworkload of the image display device 4 itself can be reduced, and itbecomes possible to display one or a plurality of cancer case lists thatare necessary criteria and a selected pathological index cursor in adisplay unit.

Also, during a diagnosis, a cancer index list is displayed, and a usercan select a pathological index cursor that is considered appropriatefrom the cancer index list using an identifier without searching fordata of complicated criteria.

The selected pathological index cursor can be used in the form of aruler, a seal, or the like according to a check-up item.

In this way, it is possible to reduce a load of the user and improveefficiency in a cancer diagnosis operation.

Further, when the server 3 and the like is used, an image processingload of the image display device 4 is reduced, and thus the user cansmoothly perform the operation even if the image display device 4displays a plurality of cancer case lists and a cancer diagnosis is madeaccording to a plurality of check-up items. In this way, efficiency inan operation for the user or the like to diagnose a stage of cancerimproves.

Further detailed operation of this embodiment will be described below.

[Operation 1a]

In the information provision device 3, data relating to a pathologicalslide image (combined image), cancer case data, and cancer index listdata is held. Specifically, the data response unit 32 of the informationprovision device 3 links the data relating to the pathological slideimage (combined image) and the cancer case data, and holds the data inthe information holding unit 33. Also, a cancer case and one or aplurality of cancer case lists are linked, and the data is held in theinformation holding unit 33.

A user or the like selects a shown image (pathological slide image(combined image), whole image (thumbnail image), or the like) or theslide ID in the image display device 4. Here, the slide ID has beenattached to pathological slide image (combined image) data as anidentifier.

The display control unit 42 of the image display device 4 makes aninquiry to the data response unit 32 of the information provision device3 based on the slide ID that is information relating to the pathologicalslide image. The data response unit 32 searches the information holdingunit 33 for a cancer case corresponding to the slide ID, one or aplurality of case lists corresponding to the cancer case, and also datarelating to a combined image corresponding to the slide, and finds thedata. When no such data is found, the data response unit 32 displays“Not found” or “Do you want to search another storage device?” and stopstemporarily.

The various kinds of found data that are necessary for image display aretransmitted from the data response unit 32 to the image display device4. From the various kinds of transmitted data, the information accessprocessing unit 421 in the display control unit 42 recovers data of thecancer case lists, data of the pathological slide image (combinedimage), and the like. The display combining unit 422 combines thesevarious kinds of recovered data into a combined image and a cancer caselist, and displays the combined image and the cancer case list in thedisplay unit 41. Also, the display combining unit 422 acquires datarelating to a size of a sample serving as a target, and decides a sizeof an appropriate pathological index cursor for the combined image and acancer index in advance.

In addition, when the user or the like selects a classified diseasestage in the cancer case list through clicking, a pathological indexcursor corresponding to the clicked portion is selected and displayed(for example, see FIGS. 9A, 9B, 10A, 10B and 10C).

When the user selects a pathological index cursor in the form of aruler, the user performs a cancer diagnosis operation by making a move,rotation, and the like of the pathological index cursor.

When the user selects a pathological index cursor in the form of a seal,if a diagnosis result corresponds to a predetermined value range shownin the cancer index list, the pathological index cursor in the form of aseal blinks or varies in color. By means of this, the user performs acancer diagnosis operation. In addition, the user can remove or addsomething from or to a screen, select blinking/no blinking, or change acolor.

When the user changes a magnification of the combined image, the size ofthe pathological index cursor is also changed according to the changedmagnification.

[Operation 1b]

As in operation 1a, various kinds of data are held in the informationprovision device 3. Description of operations that are the same as inoperation 1a will be omitted.

The image display device 4 holds data relating to an identifier servingas a slide ID—cancer case and a cancer case—one or a plurality of cancercase lists in the HDD 45 or the like.

When a user selects a slide ID in the image display device 4, thedisplay control unit 42 requests data relating to a combined imagecorresponding to the slide ID and data of one or a plurality of cancercase lists from the data response unit 32 of the information provisiondevice 3.

The data response unit 32 searches the information holding unit 33 ofthe information provision device 3 for the various kinds of requesteddata, and transmits the various kinds of data to the image displaydevice 4. The various kinds of data are processed for a combined imageand the cancer case lists in the display control unit 42, and displayedin the display unit 41. The user selects a pathological index cursorfrom disease stages of the cancer case lists, thereby performing acancer diagnosis operation.

[Operation 1c]

The information processing device 2 may perform imaging of a whole imageand partial images, and combine combined images. In this case, datarelating to these combined images is transmitted from the informationprocessing device 2 to the information provision device 3, and held inthe information holding unit 33.

A subsequent operation may be any of operations 1a and 1b.

[Operation 1d]

The information provision device 3 includes an image generator and animage processing unit with the same function as the image generationunit 22 and the image processing unit 23 of the information processingdevice 2.

Imaging is performed by the information processing device 2, and datarelating to these combined images is transmitted to the informationprovision device 3. Data relating to a combined image combined with acombined image and the like in an image generation unit and an imageprocessing unit of the information provision device 3 is held in theinformation holding unit 33.

A subsequent operation may be any of operations 1a and 1b.

Further detailed operation will be described below, but the presenttechnology is not limited to the description.

When a sample of cancer is examined, a disease stage line that a cancerinvasion distance or a cancer invasion depth exceeds is important. Forexample, in the case of stomach cancer, it is an important determinationpoint whether cancer invasion exceeds 5 mm or not. However, in anexisting system, it is difficult to make a determination as describedabove.

The server 3 holds data relating to a pathological slide image and acase (identifier) corresponding to the pathological slide image inconnection with each other. Also, the case and a list (identifier) ofdistance corresponding to the case are held in the server 3.

Based on a slide ID of a slide image (thumbnail image, combined image,or the like) shown in the viewer 4 as an identifier, the server 3receives an inquiry, and transmits an important list of distancecorresponding to the slide image to the viewer 4.

In the display unit 41 of the viewer 4, a pathological index cursorselected from a selected distance list is displayed.

Operation of the server 3 will be described.

The viewer 4 designates a slide ID and makes a request. The dataresponse unit 32 inquires of the slide ID/case data holding unit 332 ofthe information holding unit 33 based on the slide ID. The slide ID/casedata holding unit 332 finds a case corresponding to the slide ID, andfurther, the information holding unit 33 inquires of the cancer indexlist holding unit 333 holding a cancer index list about a cancer indexlist corresponding to the case. The cancer index list holding unit 333finds the cancer index list corresponding to the case, and replies tothe viewer 4 with various kinds of data of these results.

As described above, the data response unit 32 may process data in therelation of data relating to a pathological slide image→a case, and thecase→a cancer invasion distance list, and hold the processed data in theinformation holding unit 33. Also, the data response unit 32 may processdata in the relation of data relating to a pathological slide image→acancer invasion distance list, and hold the processed data. In thiscase, the data response unit 32 inquires of the cancer index listholding unit 333 about a cancer invasion distance list based on a slideID, and finds the cancer invasion distance list. In addition, the dataresponse unit 32 replies to the viewer 4 with various kinds of data ofthese results.

Operation of the viewer 4 will be described.

When data relating to a pathological slide image is acquired, the dataselection/acquisition unit of the information access processing unit 421acquires a cancer invasion distance list of the corresponding slide IDand holds the acquired distance information list.

When the data relating to the pathological slide image is acquired, therequest/decoding unit of the information access processing unit 421transmits the corresponding slide ID to the server 3 and acquiresvarious kinds of data relating to the pathological slide image. Afterthat, the request/decoding unit decodes the data of the slide and holdsthe decoded data relating to the image.

The display combining unit 422 acquires the distance list and acurrently selected distance from the data selection/acquisition unit.Also, the display combining unit 422 acquires the decoded image datafrom the request/decoding unit. The display combining unit 422 combinesand displays the decoded image data, the distance list, and thecurrently selected distance with a size of a pathological index cursor.

A user performs a cancer diagnosis operation using the pathologicalindex cursor.

FIG. 12 illustrates an example of an overall sequence of the presentdisclosure.

A slide 01 is selected by a user. First, the viewer 4 acquires distanceinformation on the slide 01. The server 3 replies with a distance listof 5 mm, 10 mm, and 15 mm.

Next, the viewer 4 makes a request for data relating to a pathologicalslide image of the selected slide 01. The server 3 replies with datarelating to a combined image corresponding to the request.

The viewer 4 decodes (recovers) the replied data relating to thecombined image, and holds the decoded data in a storage unit.

From the cancer invasion distance list, 5 mm is selected by the user.The viewer 4 displays a pathological index cursor with a size of 5 mm.

This sequence is an example, and for example, any of the distanceinformation and the data may be acquired first.

It should be understood by those skilled in the art that variousmodifications, combinations, sub-combinations and alterations may occurdepending on design requirements and other factors insofar as they arewithin the scope of the appended claims or the equivalents thereof.

Additionally, the present technology may also be configured as below.

(1) An image display device including:

a display control unit having a display combining unit that displays oneor a plurality of pathological index cursors based on informationrelating to a pathological slide image.

(2) The image display device according to (1), wherein the displaycombining unit changes a size of a pathological index cursor accordingto a magnification of a pathological slide image.

(3) The image display device according to (1) or (2), wherein thedisplay combining unit causes a pathological index cursor to blinkand/or vary in color according to classification of cancer stages.

(4) The image display device according to any one of (1) to (3), whereinthe display combining unit displays a rotatable and/or movablepathological index cursor.

(5) The image display device according to any one of (1) to (4), whereinthe display combining unit displays a pathological slide image and acancer index list for selecting the pathological index cursor.

(6) The image display device according to (5), wherein the cancer indexlist is one or two or more types of data selected from cancer invasiondistance data, cancer invasion area data, cancer invasion depth data,cancer staining data, nucleo-cytoplasmic ratio data, etiological microbenumber data, and cancer stage classification data.

(7) The image display device according to any one of (1) to (6), whereinthe display control unit further processes data relating to apathological slide image, cancer case data, and cancer index list datatransmitted from an information provision device including a dataresponse unit that acquires cancer case data and cancer index list databased on the information relating to the pathological slide image, andthe image display device displays the pathological slide image and thecancer index list.

(8) The image display device according to (7),

wherein the information provision device further includes an informationholding unit that holds data relating to a pathological slide image,cancer case data, and cancer index list data corresponding to thepathological slide image data, and

the data response unit acquires the data relating to the pathologicalslide image, the cancer case data, and the cancer index list datacorresponding to the pathological slide image from the informationholding unit based on information relating to the pathological slideimage, and transmits the acquired data to the display control unit.

(9) An image display system including:

an image display control unit having a display combining unit thatdisplays one or a plurality of pathological index cursors based oninformation relating to a pathological slide image.

(10) The image display system according to (9), further including aninformation provision device having a data response unit that acquirescancer case data and cancer index list data corresponding to the cancercase data based on the information relating to the pathological slideimage.

(11) A microscope system including:

an image display system including an image display device having adisplay combining unit that displays one or a plurality of pathologicalindex cursors based on information relating to a pathological slideimage.

(12) The microscope system according to (11), wherein the image displaysystem further includes an information provision device having a dataresponse unit that acquires cancer case data and cancer index list datacorresponding to the cancer case data based on the information relatingto the pathological slide image, and transmits the acquired data to theimage display device.

(13) An image processing method including:

displaying one or a plurality of pathological index cursors based oninformation relating to a pathological slide image.

(14) The image processing method according to (13), further including:

acquiring cancer case data and cancer index list data corresponding tothe cancer case data based on the information relating to thepathological slide image; and

displaying the pathological slide image and a cancer index list forselecting the pathological index cursors based on the cancer case dataand the cancer index list data corresponding to the cancer case data.

(15) The image processing method according to (14), wherein one or aplurality of pathological index cursors selected from the cancer indexlist are displayed.

(16) The image processing method according to (14), wherein cancer casedata corresponding to the data relating to the pathological slide imageand cancer index list data corresponding to the cancer case data isacquired based on the information relating to the pathological slideimage.

(17) A program causing an image display device to execute:

an information provision function of acquiring and transmitting cancercase data corresponding to information relating to a pathological slideimage and cancer index list data corresponding to the cancer case databased on the information; and

an image display function of displaying a cancer index list forselecting a pathological index cursor based on the cancer index listdata.

(18) A program causing an image display device to execute:

an information provision function of holding data relating to apathological slide image, cancer case data corresponding to the datarelating to the pathological slide image and cancer index list datacorresponding to the cancer case data, and acquiring and transmittingcancer case data corresponding to information relating to thepathological slide image and cancer index list data corresponding to thecancer case data based on the information; and

an image display function of displaying a cancer index list forselecting a pathological index cursor based on the cancer index listdata, and also displaying one or a plurality of pathological indexcursors selected from the cancer index list.

What is claimed is:
 1. A method, comprising: causing a display device todisplay a medical image; determining navigation data based on metadataof the medical image, wherein the metadata includes a slide number, andthe navigation data corresponds to a type of cancer corresponding to themedical image; and causing the display device to display the determinednavigation data on the medical image in a form of a ruler, wherein thedisplay of the navigation data in the form of the ruler is based on atleast one of a distance information associated with the type of canceror an area information associated with the type of cancer, a displaysize of the navigation data is adjusted based on a resolution of themedical image, and the navigation data is rotatable and movable.
 2. Themethod according to claim 1, wherein the medical image is a pathologicalimage.
 3. The method according to claim 1, wherein the medical image isan image of one of an organ of a living body, a tissue, or cells.
 4. Themethod according to claim 1, further comprising causing the displaydevice to display the navigation data in a form of a seal, wherein thedisplay of the navigation data in the form of the seal is based on acalculation of a numeric value of at least one of a number or a ratiorelated to information associated with the type of cancer.
 5. The methodaccording to claim 1, wherein the type of cancer includes one of a caseof cancer corresponding to the medical image or a status of the cancercorresponding to the medical image.
 6. The method according to claim 5,wherein the case of cancer includes at least one of a stomach cancer, alung cancer, a colon cancer, a brain tumor, a breast cancer, a cervicalcancer, an ovarian cancer, an esophageal cancer, an anal cancer, a livercancer, a pancreatic cancer, a laryngeal cancer, an oral cancer, atongue cancer, a thyroid cancer, a kidney cancer, an osteosarcoma, aprostate cancer, a testicular tumor, a renal cell carcinoma, a bladdercancer, a rhabdomyosarcoma, a skin cancer, or a leukemia.
 7. A method,comprising: causing a display device to display a microscopic image;determining navigation data based on metadata of the microscopic image,wherein the metadata includes a slide number, and the navigation datacorresponds to a type of cancer corresponding to the microscopic image;and causing the display device to display the determined navigation dataon the microscopic image in a form of a ruler, wherein the display ofthe navigation data in the form of the ruler is based on at least one ofa distance information associated with the type of cancer or an areainformation associated with the type of cancer, a display size of thenavigation data is adjusted based on a resolution of the microscopicimage, and the navigation data is rotatable and movable.
 8. The methodaccording to claim 7, wherein the microscopic image includes an image ofone of medicine, pathology, biology, or materials.
 9. An imageprocessing system, comprising: an imaging device configured to capturean image and generate image data that represents the image; and a memoryconfigured to store executable code which when executed by a processor,cause the processor to: cause a display device to display the imagedata; determine navigation data based on metadata associated with theimage data, wherein the metadata includes a slide number, and thenavigation data corresponds to a type of cancer corresponding to theimage data; and cause the display device to display the determinednavigation data on the image data in a form of a ruler, wherein thedisplay of the navigation data in the form of the ruler is based on atleast one of a distance information associated with the type of canceror an area information associated with the type of cancer, a displaysize of the navigation data is adjusted based on a resolution of theimage data, and the navigation data is rotatable and movable.
 10. Themethod according to claim 1, further comprising causing, based on acancer stage classification corresponding to the medical image, thedisplay device to at least one of blink the navigation data or change acolor of the navigation data.
 11. The method according to claim 1,wherein a shape of the navigation data is one a triangular shape, aquadrangular shape, a square shape, an oval shape, or a circular shape.12. The method according to claim 1, wherein the navigation data is inthe form of the ruler with gradations.
 13. The method according to claim7, wherein a shape of the navigation data is one a triangular shape, aquadrangular shape, a square shape, an oval shape, or a circular shape.14. The method according to claim 7, wherein the navigation data is inthe form of the ruler with gradations.
 15. The image processing systemaccording to claim 9, wherein a shape of the navigation data is one atriangular shape, a quadrangular shape, a square shape, an oval shape,or a circular shape.
 16. The image processing system according to claim9, wherein the navigation data is in the form of the ruler withgradations.